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Abstract 

On Feb 1, 2003, the Shuttle Columbia was lost during its return to Earth. As a result of the conclusion that 
debris impact caused the damage to the left wing of the Columbia Space Shuttle Vehicle (SSV) during 
ascent, the Columbia Accident Investigation Board recommended that an assessment be performed of the 
debris environment experienced by the SSV during ascent. A flight rationale based on probabilistic 
assessment is used for the SSV return- to-flight. The assessment entails identifying all potential debris 
sources, their probable geometric and aerodynamic characteristics, and their potential for impacting and 
damaging critical Shuttle components. 

A probabilistic analysis tool, based on the SwRI-developed NESSUS® probabilistic analysis software, 
predicts the probability of impact and damage to the space shuttle wing leading edge and thermal protection 
system components. Among other parameters, the likelihood of unacceptable damage depends on the time 
of release (Mach number of the orbiter) and the divot mass as well as the impact velocity and impact angle. 
A typical result is visualized in the figures below. Probability of impact and damage, as well as the 
sensitivities thereof with respect to the distribution assumptions, can be computed and visualized at each 
point on the orbiter or summarized per wing panel or tile zone. 


Introduction 

On Feb 1, 2003, the Shuttle Columbia was lost during its return to Earth. As a result of 
the conclusion that debris impact caused the damage to the left wing of the Columbia 
Space Shuttle Vehicle (SSV) during ascent, the Columbia Accident Investigation Board 
(CAIB, 2003) recommended that an assessment be performed of the debris environment 
experienced by the SSV during ascent. Eliminating the possibility of debris transport is 
not possible; therefore, a flight rationale based on probabilistic assessment is required for 
the SSV retum-to-flight. The assessment entails identifying all potential debris sources, 
their probable geometric and aerodynamic characteristics, and their potential for 
impacting and damaging critical Shuttle components. 

The analysis objective was to convert existing NASA analysis models and computer 
codes into an end-to-end probabilistic analysis tool for the assessment of external tank 
debris release, impact and damage to the orbiter (Huyse et al., 2006). Although the focus 
was mostly on the development of an analysis approach, a reliability assessment tool was 
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built using the existing NESSUS code (NESSUS, 2006). NESSUS allows the user to 
perform probabilistic analysis with both analytical models and external computer 
programs such as NASA’s debris transport codes. 

Probabilistic Modeling through Conditional Events 

The debris impact and damage mechanism are governed by the following events: 

• El : a piece of foam breaks off 

• E2: debris travels down to and impacts the shuttle 

• E3: impact is of sufficient force to damage shuttle beyond acceptable limit 

In this probabilistic modeling a failure occurs if and only if these three events occur 
concurrently; mathematically this can be expressed as: 

Vr (failure) = Vr(E l nfn E 3 ) 

= Pr(E, ) Pr (E 2 1 E x ) Pr(£ 3 1 E ] nE 2 ) 

This expression generally tracks the break down of the debris analysis into the several 
sub-disciplines involved: debris modeling, CFD analysis, impact modeling. Note that 
most of the discipline specific models are conditional in nature. For example, the CFD 
analysis used to predict the kinetic energy (event E2) of a divot inherently assumes that a 
divot has broken off (Ei). In other words the CFD model does not so much model the 
event E 2 but the conditional event E 2 IE 1 . 


Time Integration over entire mission 
Loop over multiple release locations 


E x : Debris released 

At time of release the divot mass and dimensions are predicted 
Distribution for pop-off velocity and orientation is assumed 


E 2 : Impact Probability 

Cross-range distribution from 6D0F CFD modeling 
Depends on downstream distance and radial distance to 

zero-nrt line 

E 3 : Environment - Capability 

RCC: Kinetic energy criterion 

Mass and Impact Angle adjustment 

Tile: Threshold velocity & damage depth 


Debris event analysis 


Figure 1: Functional outline of the probabilistic debris transport analysis 
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Figure 1 describes how the conditional models are nested within each other due to the 
conditioning of each event upon the other events. It is worthwhile mentioning that the 
analysis of an in-flight debris release event, for which the release conditions are fairly 
well-known (from image analysis) can be achieved by considering only the events E2 and 
E3. In each of the subsequent sections the current state of the modeling will be described. 
The probability Pr(Ei n E2 n E3) gives the probability of unacceptable damage at a given 
time of release. 

• Debris Release Ep. time-dependent probability density functions were fitted to the 
ET debris tables generated by the Shuttle Program at the NASA Michoud 
Assembly Facility. A different release table must be created for each location of 
interest. 

• Debris Transport and Impact E 2 '. during transport, lift forces act to disperse the 
debris about their idealized, or zero-lift, trajectories. Therefore, the farther 
downstream the debris travels before impact, the greater the crossrange or 
dispersion. A rotationally symmetric cross-range distribution was modeled using 
6DOF CFD results generated by NASA Ames and ELORET at Mach 2.5. 
Depending on the foam shape and initial rotation rate either a Weibull, lognormal 
or truncated normal distribution provides the best fit to the CFD results. This 
cross-range distribution is overlaid on top of the orbiter geometry to determine the 
probability of impact (Figure 2). 



Figure 2: Zero-life life and 3-sigma cone for PAL ramp release location 
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• Damage to Orbiter Eg a probabilistic capability model for both the reinforced 
carbon-carbon (RCC) wing leading edge and the orbiter tile has been 
implemented. A different distribution is used depending on the nature of the 
impact: two types of foam and ice are considered. A normal distribution is used 
for RCC and a Gumbel-min distribution is used for tile. The local incidence angle 
is an important driver for the RCC panel capability: the capability increases as the 
incidence angle becomes shallower. 

Uncertainty Modeling 


Various uncertainties affect the debris transport process. For instance, debris pieces travel 
downstream along a somewhat erratic path; advanced 6DOF CFD results were used to 
develop a stochastic model of this cross-range. Statistical descriptions of the RCC panel 
and tile zone capability were derived directly from experimental impact results. In 
addition to the highly stochastic nature of the release and transport of debris, uncertainties 
exist in the atmospheric conditions, mission profile, impact conditions, and material 
properties. Details of the uncertainty modeling can be found in Huyse et al., 2006. 

The deterministic and probabilistic models were embedded in the NESSUS software and 
predict the probability of impact and damage to the space shuttle wing leading edge and 
thermal protection system components. A right-mouse click inside the problem definition 
window activates the Debris Transport Analysis (DTA) equation database (Figure 3). By 
simply clicking on the debris release location and time of interest, the appropriate model 
and variable definition is created. 
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Figure 3: A right-mouse click in the NESSUS problem statement window activates the DTA 

equation database. 
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The analysis tool is configured to enable quick analysis of any potential debris release 
event that may be recorded during the Orbiter’s ascent into space. The conditional 
probabilistic analysis of a debris release can be performed very quickly (see Figure 4). 
For such an event the release conditions are - at least approximately - known and the 
probability Pr(E 2 n E3 1 Ei) is readily assessed. 


Loop over each release location 
Divide MET history into "Mach bins" 

Debris released 

Currently in Monte Carlo form only (result of simulation) 

Fast Probability Integration possible when parameterized 

E 2 : Impact Probability 

Single DEBRIS-DPROX run takes about 1 minute 

Impact & Cross Range information at all grid points 

Probability integration is closed form or numerical 

E 3 : Environment - Capability 

Closed form exceedance probabilities 

Debris event analysis 

Figure 4: Overview of computational aspects in current debris transport model 


In addition to the probability Pr(E2 n E3 | Ei), the code also generates plots of the 
sensitivity to a variety of distribution parameters such as the cross-range distribution. 
This is particularly of interest since the cross-range distribution type is dependent on an 
unknown initial rotation rate of the debris. These sensitivities point to the key drivers in 
the problem and were used to guide the allocation of further modeling and analysis 
efforts. 

Among other parameters, the likelihood of unacceptable damage depends on the time of 
release (Mach number of the orbiter) and the divot mass as well as the impact velocity 
and impact angle. A typical result is visualized in Figure 5. Probability of impact and 
damage, as well as the sensitivities thereof with respect to the distribution assumptions, 
can be computed and visualized at each point on the orbiter or summarized per wing 
panel or tile zone. 
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Figure 5. Typical result showing a possible re 


ease location and the impact angle (left) and 


probability of impact (right) to both the RCC panels and thermal protection shield on the 

Space Shuttle Orbiter. 


Summary and conclusions 

The probabilistic debris transport and damage analysis illustrates a practical approach to 
modeling conditional events. The probability of damage to the Shuttle is mitigated by 
including the conditions that the debris is released and that impact occurs. Accounting for 
all events in the sequence provides an accurate risk of failure. The probabilistic debris 
transport analysis specifically decoupled the release, transport, and damage events to 
evaluate either the probability of damage over the entire mission and orbiter, or to 
evaluate a specific event with a known release location, debris size, and Mach number. 
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